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DETECTING FOURIER SUBSPACES 


CHARLES A. AKEMANN AND NIK WEAVER 


Abstract. Let G be a finite abelian group. We examine the discrepancy be¬ 
tween subspaces of l 2 (G) which are diagonalized in the standard basis and 
subspaces which are diagonalized in the dual Fourier basis. The general 
principle is that a Fourier subspace whose dimension is small compared to 
|G| = dim(£ 2 (G)) tends to be far away from standard subspaces. In particular, 
the recent positive solution of the Kadison-Singer problem shows that from 
within any Fourier subspace whose dimension is small compared to |G| there 
is standard subspace which is essentially indistinguishable from its orthogonal 
complement. 


The purpose of this note is to describe a simple application of the recent solution 
of the Kadison-Singer problem 013 to a question in harmonic analysis and signal 
analysis. 

Let G be a finite abelian group equipped with counting measure, and for each 
g £ G let e g £ 1 2 {G) be the function which takes the value 1 at g and is zero 
elsewhere. Then {e g : g £ G} is an orthonormal basis of Z 2 (G); call it the standard 
basis. 

Another nice basis of 1 2 {G) comes from the dual group G, the set of characters 
of G, i.e., homomorphisms from G into the circle group T. Every character has 
l 2 norm equal to |G| 1//2 , where |G| is the cardinality of G, and the normalized set 
{e^ = |G| -1 / 2 <?!> : (j) £ G} is also an orthonormal basis of l 2 (G). We call this the 
Fourier basis. (Note that when every element of G has order 2, then the Fourier 
basis forms the rows of a Hadamard matrix mi- The method of this paper applies 
to bases of this type as well even if they don’t arise from a Fourier transform.) 

Say that a subspace of 1 2 {G) is standard if it is the span of some subset of the 
standard basis, and Fourier if it is the span of some subset of the Fourier basis. 
Now each is as far away from the standard basis as possible in the sense that 
|(e 0 ,e g )| = |G | -1 / 2 for all g £ G and <j> £ G. However, Fourier subspaces can 
certainly intersect standard subspaces — trivially, 1 2 {G) is itself both a standard 
subspace and a Fourier subspace. 

A more interesting question is whether Fourier subspaces whose dimensions are 
“small” compared to |G| can intersect standard subspaces which are small in the 
same sense. This could be of interest in relation to signal analysis, say, if we are 
trying to detect a signal by measuring a relatively small number of frequencies. 

(By interchanging the roles of a group and its dual group, we see that the problem 
of detecting standard subspaces using Fourier subspaces is equivalent to the problem 
of detecting Fourier subspaces using standard subspaces. But in keeping with the 
signal analysis perspective, we will stick with the first formulation.) 
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The basic obstacle to having small standard and Fourier subspaces which inter¬ 
sect is the uncertainty principle for finite abelian groups 0 m no]. According to 
this principle, if a nonzero function / £ l 2 (G) is supported on a set S C G and 
its Fourier transform is supported onTCG — meaning that (/, efi) ^ 0 only for 
(j> £ T — then |S|-|T|>|G|. In the special case where G has prime order p, we 
have the much stronger inequality |5| + |T| > p + 1, and this inequality is absolutely 
sharp 0. Intuitively, if / is very localized with respect to the standard basis then 
it must be “spread out” with respect to the Fourier basis. In terms of subspaces, 
the result can be stated as follows: 

Proposition 0.1. Let G be a finite abelian group and let E and F respectively be 
standard and Fourier subspaces of l 2 (G). //dim(i5)-dim(F) < |G| then EHF = {0}. 
If |G| is prime and dim(£ l ) + dim(F) < |G| then E D F = {0}. 

This follows immediately from the uncertainty principles described above be¬ 
cause the dimensions of E and F equal the number of basis elements which span 
them, so that the support of any element of E (respectively, F) has cardinality at 
most dim (£7) (respectively, dim(F)). (Uncertainty principles are related to signal 
reconstruction in a different way in fQ and related papers.) 

So standard and Fourier subspaces must intersect only in {0} if both are suffi¬ 
ciently small. However, according to the multiplicative bound in the last propo¬ 
sition, both dimensions could be as small as \G\ 1 ^ 2 , which is small compared to 
|G| when |G| is large. This means that the multiplicative bound does not prevent 
standard and Fourier subspaces whose dimensions are small compared to |G| from 
intersecting, although the additive bound when |G| is prime certainly does. Indeed, 
there are easy examples of intersecting standard and Fourier subspaces whose di¬ 
mensions are both equal to | G | 1//2 . 

Example 0.2. Let G = Z/n 2 Z, where |G| = n 2 and the characters have the form 
(j>b : a i-»- e 2mab / n2 f or a ,b £ Z/n 2 Z. Here the function f = <finb £ 1 2 {G) 

satisfies 

f(a) = V e 2 ™ ab/n = I U ^ U ~ ° ( m ° d U ^ 

\0 ifa^Q(modn), 

so that f belongs both to an n-dimensional Fourier subspace (directly from its defi¬ 
nition) and to an n-dimensional standard subspace (by the preceding calculation). 

From the point of view of signal analysis, however, we are probably not so 
interested in intersecting a single standard subspace. If we do not know where 
the signal we want to detect is supported, we would presumably want to intersect, 
if not every standard subspace, at least every standard subspace whose dimension 
is greater than some threshold value. But unless the relevant dimensions are large, 
this is impossible for elementary linear algebra reasons. We have the following 
simple result: 

Proposition 0.3. Let G be a finite abelian group and let F be a Fourier subspace 
of l 2 (G). Then there exists a standard subspace E with dim(£ l ) = |G| — dim(F') 
such that E D F = {0}. 

The proof is easy. Starting with the standard basis B = {e g : g £ G} of 
1 2 {G) and the basis B' = {e$ : <f £ T} of F, we can successively replace distinct 
elements of B with elements of B' in such a way that the set remains linearly 
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independent at each step. The end result will be a (non orthogonal) basis of 1 2 {G) 
of the form B' U {e g : g £ S} for some set S C G with |= |G| — dim(.F). Then 
E = span{e s : g G S} is the desired standard subspace which does not intersect F. 

Thus, if the dimension of a Fourier subspace is small compared to |G|, there will 
be many standard subspaces whose dimensions are small compared to |G| which it 
does not intersect. But requiring subspaces to intersect is a very strong condition. 
Merely asking that the Fourier subspace contain unit vectors which are close to 
the standard subspace makes the problem much more interesting and difficult. 
Nonetheless, we can still get something from simply counting dimensions. Namely, 
if is any Fourier basis vector and E is a standard subspace, then, letting P be 
the orthogonal projection onto E = span{e 9 : g £ S}, we have 


ll^f 


2 


e g) e 9 

g eS 


dim (£7) 


Thus, even a single Fourier basis vector can “detect” arbitrary standard subspaces 
to the extent that those subspaces have dimension comparable to |G|. 

Can Fourier subspaces do better? The relevant gauge here is the quantity 


||PQ|| = ||QP|| = supdlOU :v£E, ||u|| = 1} 


where P and Q are the orthogonal projections onto a standard subspace E and 
a Fourier subspace F, respectively. It effectively measures the minimal angle be¬ 
tween E and F. The surprisingly strong result is that, by this measure, so long as 
the dimension of a Fourier subspace is small compared to |G|, there are standard 
subspaces which it detects only marginally better than a single Fourier basis vector 
does. 

One might suspect that a randomly chosen standard subspace would demonstrate 
that claim. Maybe this technique would work for most Fourier subspaces, but it 
does not in general, even for Fourier subspaces whose dimension is small compared 
to |G|. 


Example 0.4. Recall Example 0.2 where an n-dimensional Fourier subspace F 
intersected an n-dimensional standard subspace E. Here dim(F)/|G| = 1/n, which 
can be as small as we like. Now consider the group G' = Z/n 2 Z x Z/iVZ where N 
is large compared to n. We have a natural identification 

l 2 (G') £* Z 2 (Z/n 2 Z) ® 1 2 {Z/NZ), 

under which identification F ® l 2 (Z/NZ) is a Fourier subspace. The ratio of its 
dimension to the cardinality of G' is still 1/n. But for sufficiently large N, a ran¬ 
domly chosen subset of G' will contain at least one element of S x Z/NZ with high 
probability, where E = span{e s : g £ S}. One can even say this of a randomly cho¬ 
sen subset of G' of cardinality \G'\/n. This means that a randomly chosen standard 
subspace of dimension \G'\/n will intersect the Fourier subspace F®l 2 (Z/NZ) with 
high probability — depending on the value of N, with probability as close to 1 as we 
like. 


Nonetheless, if a Fourier subspace F has relatively small dimension, there will 
always exist standard subspaces of arbitrary dimension which are barely closer to 
F than they are to a single Fourier basis vector. We have the following theorem: 
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Theorem 0.5. Let G be a finite abelian group, let F be a Fourier subspace ofl 2 (G), 
and let Q be the orthogonal projection onto F. Then for any k < \G\ there is a set 
S C G with |S| = k and such that 

\\PQ\\ 2 <-^+0(V~e), 

where P is the orthogonal projection onto span{e g : g £ 5} and e = dim(.F)/|G|. 

This result is strengthened further by Theorem 10.61 below, but Theorem 0.5 has 
an easier proof which is of independent interest. We include this proof in the 
appendix. 

The strengthened version of Theorem 10.51 simultaneously asks the same question 
about the complementary standard subspace. If our goal is detection, then the worst 
that could happen here is that a Fourier subspace F does essentially no better than 
a single Fourier basis vector at detecting either some standard subspace E or its 
orthocomplement E ± . In fact, this worst-case scenario is realized: we can show that 
every Fourier subspace of small dimension relative to |G| fails to do significantly 
better than a single Fourier basis vector at detecting both a sequence of standard 
subspaces of varying dimension and their orthocomplements. 

In this case, constructing the undetectable standard subspaces is no longer 
merely a matter of controlling the largest eigenvalue of QPQ (which suffices be¬ 
cause HQ-PQH = ||PQ|| 2 ). Now we also have to control the largest eigenvalue of 
Q( 1 — P)Q , and this is a Kadison-Singer type setup. Although the problem we con¬ 
sider here is not as general as the full Kadison-Singer problem, the core difficulty 
is clearly already present. Thus, one should not expect any easier proof than the 
ones that appear in [S3, lH or the remarkable generalization in [3]. 

Theorem 0.6. Let G be a finite abelian group, let F be a Fourier subspace ofl 2 (G), 
and let Q be the orthogonal projection onto F. Then for any k < |G| there is a set 
SC G with |S'! = k and such that both 

\\PQ\\~ < |^| + O(Ve) 

and 

||(/-P)Q|| 2 <^^ + 0( v / i) 

where P is the orthogonal projection onto span{e g : g £ S} and e = dim(F’)/|G|. 

Proof. For each g £ G let u g = Qe g £ F. Then the rank one operators u g u* : f i-A 
(f,u g )u g satisfy 


u 9 u *gf = (f’ Q e a) -Qe g = Q 

g£G geG 



?) e g 


Qf 


for all / S l 2 (G ); that is, Xl g eG u 9 u 9 = Q- We also have ||u g || 2 = ||Qe g || 2 = e for 
all g. So by an, comment following Corollary 1.2), for any k < |G| there is a set 
S C G such that 


ges 



= 0(y/e). 
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Letting P be the orthogonal projection onto span{e s : g £ 5}, we have P = 
E seS e s e*, and it follows that 


QPQ 



Y, U 9 U l 

g£S 



= 0(y/e), 


which also implies 


We therefore have 




0(V~e). 


\\PQ\\ 2 =\\QPQ\\<— + 0 (V~e) 


and 

||(J - P)Q|| 2 = \\Q(I ~ P)Q\\ < + 0(V~e), 

as desired. The set S might not have cardinality exactly k, but it cannot have 
cardinality greater than k + 0(yfe) or less than k — 0(\fe), so it can be adjusted to 
have cardinality k without affecting the order of the estimate, if needed. □ 


In particular, taking k ss |G|/2 in Theorem 10.61 we get 

||PQ|M|(1-P)Q||«-^. 

This implies that every nonzero vector in ran(P) is roughly 45° away from P, and 
the same is true of every nonzero vector in ran(P) _L . That is, if e is small then from 
within F the two subspaces are essentially indistinguishable. Another way to say 
this is that every vector in F has roughly half of its l 2 norm supported on S and 
roughly half supported on G\ S. 


Appendix A. 

We prove Theorem 10.51 The argument is a straightforward application of the 
spectral sparsification technique introduced in Srivastava’s thesis [8]. 

Let { u \,..., u n } be a finite set of vectors in C m , each of norm y/e, satisfying 

n 

Y UiU* = I 
i=1 

where u^u* is the rank one operator on C m defined by UiU* : v >->• ( v,Ui)ui and I 
is the identity operator on C m . Note that Tr(ujit*) = Tr (u*Ui) = ||ui|| 2 = e; since 
Tr(7) = m, it follows that ne = m. 

Let k < n. As in [8j, we will build a sequence uq,..., m k one element at a time. 
The construction is controlled by the behavior of the operators Aj = Ed=i Ui d u i d 
using the following tool. For any positive operator A and any a > ||A||, define the 
upper potential $ a (A) to be 

$ Q (A) =Tr((a7- A)" 1 ); 

then, having chosen the vectors u q,..., Ui j _ 1 , the plan will be to select a new vector 
liq so as to minimize 'L 0 ' 3 ( Aj ), where the aj are an increasing sequence of upper 
bounds. This potential function disproportionately penalizes eigenvalues which are 
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close to a,j and thereby controls the maximum eigenvalue, i.e., the norm, of Aj. 
The key fact about the upper potential is given in the following result. 


Lemma A.l. (18], Lemma 3.4) Let A be a positive operator on C m , let a, 5 > 0, 
and let v £ C m . Suppose ||A|| < a. If 


(((a + 5)1 - A) 2 v,v) 
$ a (A) - $ a+5 (A) 


(((a + 6)1 -A) 1 v,v) < 1 


then ||A + iw*|| < a + (5 and $ a+<5 (A + vv*) < <b a (A). 


The proof relies on the Sherman-Morrison formula, which states that if A is 
positive and invertible then ( A + vv *) _1 = A -1 — A I+ ^i^ ■ 

We also require a simple inequality. 


Lemma A.2. Let a\ < ■ ■ ■ < a m and b\ > ■ ■ ■ > b m be sequences of positive real 
numbers, respectively increasing and decreasing. Then E aA < 

Proof. Let M = — E &*• We want to show that E a ibi < Yl a iM, i.e., that 
Efli(^i — M) < 0. Since the sequence (bi) is decreasing, we can find j such 
that bi > M for i < j and bi < M for i > j. Then Ei=i a *(^i — M) < 
dj Ei=i (Pi ~ M) (since the a* are increasing and the values bi — M are positive) 
and EEj+i a i(bi — M) < aj EEj+i^* — Af) (since the eq are increasing and the 
values bi — M are negative). So 

m m 

Y CLi{bi — M) < aj ^(6* - M) = 0, 

i =1 i=1 

as desired. □ 


Theorem A.3. Let m £ N and e > 0, and suppose {?q,..., u n } is a finite sequence 
of vectors in C m satisfying ||rtj|| 2 = e for 1 < i < n and EEi u i u *i = T Then for 
any k < n there is a set SC{l,...,n} with |5| = k such that 


^ Z u iU* 

ies 


<- + 0(V~e). 

n 


Proof. Define aj = y/e + 1 _ 1 ^ • ^ for 0 < j < k. We will find a sequence of distinct 

indices ii,...,ik such that the operators Aj = Y)d=i u id u i d i 0 < j < k, satisfy 
||Aj|| < aj and <J> a °(A 0 ) > • • • > $ afc (A fc ). Thus 

\\M < y/e + t -y= • — = —f 0(y/e), 

1 — ye n n 

yielding the desired conclusion. We start with Ao = 0, so that <f> a °(Ao) = <& v ^(0) = 
M(Vel)- 1 ) = m/sfe. 

To carry out the induction step, suppose u^,... ,Ui j have been chosen. Let 
Ai < ••• < A m be the eigenvalues of Aj. Then the eigenvalues of / — Aj are 
1 — Ai > • • ■ > 1 — A m and the eigenvalues of (eq+i/ — Aj) -1 are < • • • < 

-. +1 E ■ Thus by Lemma IA.2I 

m 

T 'r{{a i+ iI-A i )-\l-A j )) = £- r (l - A.) 

a i+i “ A * 
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< 


-Ed-^) 


< 

< 


ly—L 

m ti °3'+l - 

“Tr((a :( '_|_ 1 J — A,) _1 )Tr(/ — Aj) 

—$ a i+'(Aj)Tr(I - AA 

m 

— § a i M,-)Tr(J — An) 

TO 

— r»(A 0 )Tr(/- AA 

m 

-LTrd-A,). 


Next, cij +1 — aj = yr~T ■ so we can estimate 


^(Aj)-^(Aj) = Tr((ajl - Aj)- 1 - (a j+1 I - Aj)- 1 ) 

= 1 1 r • -Tr((ojJ - ^) _1 (aj + i/ - Aj)- 1 ) 

i — V e it 

since each of the eigenvalues — -. +1 1 _ A . of the operator (ajl — Aj)~ 1 (cij + il — 

Aj) -1 is greater than the corresponding eigenvalue ^ a , +i 1 _ A .^ of the operator 
(ajj.il— Aj)- 2 . Combining this with Lemma TA . 2 1 yields 

Tr ((a j+1 I-Aj)- 2 (I-Aj)) < ±-Tr((a j+1 I - Aj)~ 2 )Tr(I - Aj) 

< - e (l - V~e)(^(Aj) ^(Aj))Tr(I - A,). 


Thus 


Tr(( °E! , A i 2{ \ a f j)) < “(I - \/e)Tr(7 - Aj). 
(Aj) - (Aj) ; v J 


Now let S' C n} be the set of indices which have not yet been used. 


Observe that ( Au,u) = Tr(Al('U'u*)) and that J2i^S' v " iU i = I ~ Yjd= 


Ui^U, = 


I — Ai. Thus 


= 1 “Id “id 


E 


f (dj+i 1 Aj) 


ies 


\ \ $ a i(Aj) - $ a J+!( Aj) 


+ ((a j+1 I-Aj) 1 u i ,u i ) 


Tr ((a j+1 I-Aj)- 2 (I-Aj)) 


+ T \((a j+l I - Aj)-\I - Aj)) 


But 


& a i(Aj) - $ a i+ 1 (Aj) 

< -(1 - vd)Tr(/ - Aj) + ±=Tr(I - A,) 

t ye 

= - e Tr(I-Aj). 


^Tr (I - Aj) = \m - Tr(A,)) =n- j 


is exactly the number of elements of S'. So there must exist some i £ S' for which 


((a j+1 I - Aj) 2 u l ,u i ) 
$ a i(Aj) - <& a i+i(Aj) 


H" ((^j+l I Aj) ^ii^i) — 1* 
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Therefore, by Lemma [A. 11 choosing u, . +1 = m allows the inductive construction to 
proceed. □ 

Theorem 10.51 follows by taking m = dirn(F). e = m/\G\, and u,; = Qei for 
1 < i < n = |G|, and identifying F with C m . Letting P be the orthogonal 
projection onto span{ej : i £ 5}, we then have ||PQ|| 2 = ||QPQ|| = || TieS u j u ill- 
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